neurips2026-speculative-decoding.vercel.app · 32 min
A thorough tutorial on speculative decoding, the technique where a small model drafts tokens for a big one to verify, traces its evolution since 2023 and clarifies when it stays lossless. This is the kind of engineering detail that actually moves inference costs down.

